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(57) Abstract 

Apparatus and methods arc provided for embedding watermark information into a cover signal (2). such as an audio signal, video 
signal, or still image signal, in a manner that prevents the watemiark information from being removed widiout degrading the quality of the 
cover signal. This is accomplished by subjecting the cover signal to a phase modulation (6) prior to being embedded with the watermark 
information (8). wherein the amount or degree of phase modulation is changed (3, 5) at least for each diffeient watemiark to be embedded 
in a particular instance or copy of the cover signal. As such, if two copies of die same cover signal, each containing a different watennark. 
are averaged or combined in an attempt to obliterate the watermark information, the cover signal will be subjected to phase cancellation, 
rendering any illicit copy of such signal so derived to be valueless. 
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METHOD AND APPARATUS FOR 
PREVENTING REMOVAL OF EMBEDDED INFORMATION 
IN COVER SIGNTkLS 



BACKGROUND OF THE INVEKTTOW 
5 Field of the Invenh-ini^ 

This invention generally relates to apparatus and 
methods for encoding or embedding information in cover 
signals, such as audio, video and data signals, either 
transmitted by radio wave transmission or wired 

10 transmission, or stored in a recording medium such as 

optical or magnetic disks, magnetic tape, or solid 
state memory. In particular, the present invention 
relates to methods and apparatus for preventing the 
embedded information from being removed or obliterated 

15 from the cover sigrja!* 

Background and Description of Relat^fS Ar-t 

With the advent of the Internet and improvements 
in digital technology, it is becoming possible to make 
unlimited copies of copyrighted content such as audio, 

20 video, still images and the like, without degradation 

of the original content. For example, there is 
currently a large market for audio software products, 
such as musical recordings. One of the problems in 
this market is the ease of copying such products 

25 without paying those who produce them. This problem is 

becoming particularly troublesome with the advent of 
recording techniques, such as digital audio tape (DAT) , 
which make it possible for copies to be of very high 
quality. It is thus desirable to be able to prevent 

30 the unauthorized copying of audio recordings, including 
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the unauthorized copying of audio works broadcast over 

the airwaves or made available on the Internet. 

Recently, a significant amount of attention has 

been given to various methods for digital 
5 "watermarking" of copyright protected program material. 

As opposed to encryption, in which the content of the 

program itself is subjected to scrambling or encoding, 

such that without the correct decoder equipment, the 

content cannot be reproduced, watermarking relates to 
10 the insertion into program material such as audio or 

video signals digital information identifying the 

copyright holder and/or the purchaser of a particular 

copy of the audio or video program in a manner which is 

imperceptible to the listener or observer. The 
15 watermarking information is thus hidden from the 

ordinary recipient of the program, and can be detected 

only by use of appropriate apparatus or knowledge of 

the watermarking parameters. Such watermarking is also 

known as steganography . Literally meaning "covered 
20 writing" from the Greek, steganography has been defined 

as the art and science of communicating in a way which 

hides the exiiJieace of the; communicafrion. -- W' -"^^ 

Various prior art methods of encoding auxiliary 

hidden information onto a source or cover signal are 
25 known in the art. S^, e.g. , U.S. Patent Nos. 

5,319,735; 5,450,490; 5,613,004; 5,687,236; 5,636,292; 

and 5,574,962. 

In the area of copyright enforcement, the 

watermark information may contain the identity of the 
30 purchaser of a particular copy of the audio, video, or 

other program material. Thus, each copy of the same 

audio or video program would contain a different 

watermark to the extent that such copy is purchased by 

a different entity. 
35 The value of any watermarking technique lies in 

its resistance to removal from the cover signal, 

without also destroying the content of the audio or 
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video program in which it resides. In this regard, 
there exists a problem in the art known as a collusion 
attack. A collusion attack results when two or more 
copies of a program signal with different watermarks 
5 are combined in some manner, such as averaging or 

interleaving, whereby the watermark information is 
obliterated, while the quality of the content 
information is preserved. Because the program content 
is identical, averaging the signal will produce the 
10 same content. However, the watermarking information 

would be destroyed because this information would be 
different for each copy of the cover signal, so that 
averaging of the copies would in effect "erase" the 
watermark. 

15 Prior techniques for defending against such 

collusion attacks are known in the art. Such 
techniques have focused on adding redundancy to 
watermarking codes to obtain similarity in at least a 
portion of the watermark information in different 

20 copies. For example, U.S. Patent No. 5,664,018 to 

Leighton discloses a method wherein a secret "baseline" 
watermark is creciLeci from ci digital, strii'.r^ of the work 
to be marked, which is then used to create a set of 
modified watermarks, each having a certain relationship 

25 to the baseline watermark. Each modified watermark is 

then inserted into a copy of the work to create a 
watermarked copy of the work. If any small subset of 
the modified watermarks are averaged, at least one of 
the watermarks will remain. 

30 Several significant disadvantages exist in the 

known methods for preventing watermark removal. First, 
use of data redundancy imposes a large penalty on the 
required length of the watermark data with respect to 
the actual embedded information. Second, such anti- 

35 collusion methods actually cannot prevent removal of 

watermarks if a sufficiently large number of copies is 
used in the averaging. Collusion attacks using a 
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sufficient number of different copies will completely 
remove the watermarks without causing any degradation 
of the cover signal content. As such, there exists a 
need in the art for improvement in methods and 
5 corresponding apparatus for preventing the removal of 

watermark information from cover signals . 

SUMMARY OF THF. INVENTION 

The present invention solves the abovementioned 
problems in the art and provides a method and apparatus 

10 for embedding watermark information into a cover signal 

such that any attempt to remove the embedded watermark 
information will cause significant degradation of the 
cover signal itself, rendering it commercially useless. 
The method and apparatus according to the present 

15 invention does not require any redundancy in 

watermarking codes or information, and is applicable to 
any method or technique for adding or embedding 
watermark information into a host or cover signal, 
whether it be an audio signal, video signal or still 

20 image signal. 

In particular, according to one aspect the present 
' y^:^^^.. Ixi^jr^nt^GTi provides a method for -eaibedding. waterihaj.k^ 

information into a coyer signal, comprising the steps 
of selecting values of predefined phase modulation 

25 parameters for the cover signal, modulating the phase 

characteristics of the cover signal according to the 
selected phase modulation parameter values to obtain a 
phase -modulated cover signal, and embedding the 
watermark information into the phase -modulated cover 

30 signal to obtain a stego signal, wherein the phase 

modulation parameter values are selected such that 
combining any two or more instsuices of the stego signal 
containing different watermark information will produce 
significant distortion with respect to the cover signal 

35 as a result of phase misalignment. 

According to another aspect, the present invention 
provides apparatus for embedding watermark information 
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into a cover signal, comprising a phase modulation 
parameter generator for providing values of predefined 
phase modulation parameters, a phase modulator for 
modulating the phase characteristics of the cover 
signal in accordance with the phase modulation 
parameter values to produce a phase -modulated cover 
signal, and a watermark information embeddor for 
embedding watermark information into the phase- 
modulated cover signal to obtain a stego signal. 

BRIEF DRSCRIPTION OF thtc np^yfT^rfc 

These and other aspects of the present invention 
will become more fully understood from the following 
detailed description of the preferred embodiments in 
conjunction with the accompanying drawings, in which: 

FIG. 1 is a block diagram illustrating one 
preferred embodiment of an apparatus for embedding 
watermarking information into a cover signal according 
to the present invention; 

FIG. 2 is a block diagram illustrating one 
preferred embodiment of the phase modulator 6 and phase ^ 
modulator parameter generator 5 of FIG. i; aud — -n-S^--. * r --^e^ 

FIG. 3 is a block diagram illustrating an 
alternate preferred embodiment of the phase modulator 6 
and phase modulator parameter generator 5 of FIG. 1. 

PETAII.ED DK>Sn?T PTTON OF THK PRKFERRKn RiymnnTNp Kq-ff 
The present invention is directed to a method and 
apparatus for embedding watermarking information into a 
cover signal, such as a video signal, an audio signal, 
or a still image signal (such as a JPEG, GIF, TIF or 
BMP signal) , in a manner such that any attempt to 
remove the watermarking by combining together two or 
more copies of the same cover signal but containing 
different watermarks, will result in significant 
degradation of the cover signal by introducing 
undesired artifacts into the resultant signal. 



10 



15 



20 
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As shown in Fig. 1, according to one preferred 
embodiment of the invention, a phase modulator 6 
receives a cover signal 2 (such as an audio signal, 
video signal, still image signal, or multimedia signal) 

5 and modulates the phase characteristics of the cover 

signal 2 in accordance with predefined variable 
modulation parameters 3 generated by a phase modulator 
parameter generator 5. The resultant phase -modulated 
cover signal 4 is then applied to a watermark embeddor 

0 8, for embedding into the phase -modulated cover signal 

4 appropriate watermarking information, to obtain a 
Btego signal 10. Stego signal 10 thus contains the 
same content as cover signal 2, but includes watermark 
information. The specific watermarking process 

5 utilized by watermark embeddor 8 is not material to the 

present invention, and any known method of embedding 
watermark information, including the methods mentioned 
above, could be used in the implementation of embeddor 
8. 

0 The phase modulator 6, modulation parameter 

generator 5, and watermark embeddor 8 can be 
impleniented either a's sofr^wsce on a gi^iteral 
programmable data processor, as an analog or digital or 
mixed-signal integrated circuit, as a discrete 

5 component electronic circuit, or as a combination of 

such devices. 

The phase -modulated cover signal 4 is produced by 
the phase modulator 6 by altering the phase of the 
cover signal components either in a fixed or time- 

3 varying manner, and in accordance with modulation 

parameters provided by parameter generator 5. A number 
of known techniques for altering the phase structure of 
a signal may be used; however, two specific examples 
will be described below with reference to Figs. 2 and 3 

5 for purposes of illustration. For any such technique, 

for any fixed modulation parameter values, the phase 
modulation can be either linear or nonlinear with 
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respect to frequency in the time dimension and/or one 
or more spatial dimensions. While any type of phase 
modulator can be used to implement the phase modulator 
6, it must the following requirements: 
5 1) the phase modulator 6 should cause minimal 

disturbance with respect to the perception of the cover 
signal 2, be it sound, video or still image; 

2) any averaging between two or more phase- 
modulated versions of the cover signal should lead to 

10 noticeable distortion of the cover signal with respect 

to its perception as sound, video or a still image. 

The phase modulation parameters 3 are changed at a 
minimum each time a new copy of a specific cover signal 
2 is to be watermarked with different watermark data. 

15 This is required so that different watermarked copies 

of the same cover signal will undergo a destructive 
phase cancellation if combined in an attempt to remove 
the watermark data. To prevent the phase modulation 
from being reversed during a collusion attack, the 

20 phase modulation parameters 3 may be changed during the 

phase modulation of a particular cover signal, either 
. ^ randondy or systematically, to thefeby^ dbtai;^i a si^jnal . "^S':- 
phase modulation that varies either in i:ime, space, or 
in some other signal dimension. 

25 Further, it is also possible for the phase 

modulation parameters to be selected in such a way that 
in addition to meeting the above requirements, they 
also serve to embed additional hidden information which 
may be extracted from the stego signal alone, the stego 

30 signal in comparison with the cover signal, or from a 

colluded signal obtained from multiple copies of stego 
signals derived from the same cover signal but with 
different watermark data. 

35 Referring to Fig. 2, a first representative 

embodiment of the phase modulator and modulation 
parameter generator will be described. In this 
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embodiment, the cover signal 2 is assumed to be one- 
diraensional and uniformly sampled in time. The phase 
modulator is implemented in this embodiment by a 
digital all -pass filter 6a. Such digital all -pass 
5 filters are generally known in the art and for this 

reason a detailed description of such filters will not 
be given here. 

The phase modulation parameter generator is 
implemented as a filter coefficient generator 5a. The 

10 number of poles, or order of the all -pass filter is 

arbitrary. In this exan5)le, the all -pass filter 6a is 
assumed to be a single second-order infinite impulse 
response (IIR) filter. This example further assumes a 
digitized cover signal 1, but a corresponding analog 

15 domain embodiment is also encompassed by the invention 

and can be readily implemented by those skilled in the 
art based on the discussion herein. 

The cover signal 2 is inputted to the IIR filter 
6a, which also receives time -varying filter 

20 coefficients from coefficient calculator 5a. The 

difference equation describing the operation of the 
filterr-6a-^is- expressed as; 

y(n)=A„(x{n)+a„x{n-l)+b„x(n-2) )+c„y(n-l)+d„y(n-2) (1) 



where x(n) is the nth sample of the cover signal 2, 
25 y(n) is the nth sample of the phase -modulated cover 

signal 4, and an/ b^, Cn, d„, X„ are time varying filter 
coefficients 3a constituting the modulation parameters. 
The filter coefficients can be updated for each output 
sample of the filter 6a by the coefficient calculator 
30 5a. A useful method for obtaining appropriate values 

for the coefficients is to use desired values of the 
poles' magnitude a{n) and phase <p(n) at the nth 
instant, and can be obtained using the following 
relationships : 



wo 99/39344 



PCTAJS99/02188 



10 



15 



20 



25 



- 2CQS (D(n) 
a{n) 



dn = 



of=(n) 
2a (n) cos(p(n) 
-a*(n) 

ll-2a(n)r!OHmfn^tff^(y^) | 



1 - 2coB<D(n) + 
a(n) 



(2) 

(3) 

(4) 
(5) 

(6) 



Systems for which the time variations of the 
poles' magnitude and phase follow slow sweeps of chosen 
magnitude and phase ranges have been implemented 
successfully and found to comply with the requirements 
given above. The initial conditions, rate and 
direction of change of such sweeps are systematically 
randomized to ensure a difference between results of 
distinct phase modulations applied to the same cover 
signal. Satisfactory results have been obtained on 
audio signals when using the following choices for 
magnitude and phase ranges and the speed of variation 
of those parameters: 



r . 

fs 



f. 



J 



30 



a{n) e [0.8, 0.9] 
|a(n)-a(n-l) | < iLi 

fa 

|(p(n)-(p(n-l)| < ^smR 



(7) 

(8) 
(9) 

(10) 



35 



where f, refers to the sampling frequency of the cover 
signal in cycles per second (hertz) . 
Second RifniiTpia 

Referring to Pig. 3, a second representative 
embodiment of the phase modulator and modulation 
parameter generator will be described. In this 
embodiment, the phase modulator 6 is implemented by a 
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interpolator 6b, and the phase modulation parameter 
generator 5 is implemented by a sampling location value 
calculator 5b. The interpolator and sampling location 
value generator together produce a time-varying linear 
phase modulation which is essentially equivalent to 
non-uniform resampling of the original cover signal 2. 
In other words, this embodiment of the phase modulator 
and modulation parameter generator produces the effect 
of slightly speeding up or slowing down the cover 
signal 2 in a time-varying manner. 

In this embodiment, cover signal 2 is assumed to 
be a discrete-time signal x{n), where n=0 corresponds 
to the beginning of the cover signal. The phase- 
modulated cover signal 4 is referred to as y(n), u(n) 
15 refers to the continuous -time sampling location for the 

nth output sample of the interpolator 6b, and sp{n) 
refers to the time-varying sampling interval which is 
provided to the sampling location value calculator 5b. 
Sampling location value calculator 5b produces 
20 continuous-time sampling location u(n) according to the 

following relationship with time-varying sampling 
interval .sp(n) .: ^ , 

n 

u(n)=Xlsp(k) 

25 k=o ^ ^ 

Provided with sampling location u(n) and cover signal 
x(n), interpolator 6b produces phase-modulated cover 
signal 4 according to the following relationship: 



30 y(n)=Xe(u(n))=Xc (Lsp{k)) (12 

k=o 

where Xc(t) represents a continuous -time version of the 
discrete-time cover signal x(n) . Xc(t) is derived from 
x{n) through interpolation, which may be performed 
35 through polynomial interpolation, bandlimited 

interpolation or one of the many other interpolation 
techniques known in the art. Sampling interval sp(n) 
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typically will vary slowly in time while confining its 
value within a narrow interval around 1. These 
conditions are illustrated by the following 
relationships: 

5 |sp(n)-sp(n-l) I < tjt^, (13) 

|sp(n)-l| ( 82 (14) 



where f^ refers to the sampling frequency of the cover 
signal 2 in hertz, and 81 and 83 are constants chosen to 
avoid any perpetual discrepancy between cover signal 

10 x(n) and its phase -modulated version y(n) . 

Systems for which time variations of sp(n) are 
chosen to follow a slow sweep that satisfies equations 
(13) and (14) have been successfully implemented and 
found to produce the required properties discussed 

15 above, with 81=0.01 Hz and 82=0.01. The initial 

conditions, rate and direction of change of the sweep 
in such systems are systematically randomized to ensure 
a difference between the results of distinct phase 
modulations of the same cover signal. 

2Q The invention having been thus described, it will 

be apparent to those skilled in the art that the same 
may be varied in many ways without departing from the 
spirit and scope of the invention. Any and all such 
modifications as would be apparent to those skilled in 

25 the art are intended to be covered by the following 

claims . 
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What is claimed is: 

1. A method for embedding watermark information into a 
cover signal, comprising the steps of: 

selecting values of predefined phase modulation 
parameters for said cover signal; 
5 modulating the phase of said cover signal 

according to said selected phase modulation parameter 
values to obtain a phase -modulated cover signal; and 

embedding said watermark information into said 
phase-modulated cover signal to obtain a stego signal; 
10 wherein 

said phase modulation parameter values are 
selected such that combining any two or more instances 
of said stego signal containing different watermark 
information will result in phase cancellation with 
15 respect to the combined signal. 

2. A method as set forth in claim 1, wherein said 
phase modulation parameter values are time -varying 
during phase modulation of said cover signal. 

3- A method as set forth in claim 1, wherein said 
phase modulation parameter values are randomly selected 
~^i^.f 0r each Wcitearmarking embeddiiig opexaLion ort^l^^xi'^cover 
si^al. 

4. A method as set forth in claim 1, wherein the step 
of modulating comprises passing said cover signal 
through an all -pass filter, and said phase modulation 
parameters are filter coefficients for said all-pass 
filter. 

5. A method as set forth in claim 1, wherein the step 
of modulating comprises passing said cover signal 
through a sampling interpolator, and said phase 
modulation parameters are sampling location values with 
respect to said cover signal. 

6. A method as set forth in claim 1, wherein said 
cover signal is an audio signal, 

7. A method as set forth in claim 1, wherein said 
cover signal is a video signal. 
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8. Apparatus for embedding watermark information into 
a cover signal, comprising: 

a phase modulation parameter generator for 
providing values of predefined phase modulation 
5 parameters; 

a phase modulator for modulating the phase of said 
cover signal in accordance with said phase modulation 
parameter values to produce a phase -modulated cover 
signal ; ouid 

0 a watermark information embeddor for embedding 

watermark information into said phase -modulated cover 
signal to obtain a stego signal. 

9. Apparatus according to claim 8, wherein said phase 
modulator comprises an all-pass filter, and said phase 
modulation parameters comprise filter coefficients for 
said all^pass filter. 

10. Apparatus according to claim 8, wherein said phase 
modulator comprises a sampling interpolator, and said 

_ phase modulation parameters comprise sampling location 
values with respect to said cover signal. 

11. i^paratus according to claim 8, wherein said cover 
signal is ah-^audio. signal . 

12. Apparatus according to claim 8, wherein said cover ' 
signal is a video signal. 

13. Apparatus according to claim 8, wherein said phase 
modulation parameter values are time -varying during 
phase modulation of said cover signal. 

14. Apparatus according to claim 8, wherein said phase 
modulation parameter values are randomly selected for 
each watermarking embedding operation on said cover 
signal. 

15. A method for preventing removal of watermark 
information embedded into a cover signal, comprising 
the steps of: 

modulating the phase of said cover signal by an 
; amount which varies at least as a fiinction of the 
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content of said watermark informatioil, to produce a 
phase -modulated cover signal; and 

embedding said watermark information into said 
phase -modulated cover signal. 

16. A method as set forth in claim 15, wherein the 
step of modulating comprises passing said cover signal 
through an all-pass filter, and the amount of phase 
modulation is determined by filter coefficients for 
said all -pass filter which change with different 
watermark information. 

17. A method as set forth in claim 15, wherein the 
step of modulating comprises passing said cover signal 
through a sampling interpolator, and the amount of 
phase modulation is determined by sampling location 
values with respect to said cover signal, which change 
with different watermark inf onnation. 

18. A method as set forth in claim 15^ wherein said 
cover signal is an audio signal. 

19. A method as set forth in claim 15, wherein said 
cover signal is a video signal. 
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